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AjlETHOD AND APPARATUS FOR SETTING PROGRAMMABLE 
FEATURES OF AN APPLIANCE 

1 BACKGROUND OF THE INVENTION 

1. FIELD OF THE INVENTION 

This invention relates generally to the field of setting programmable features of 
an appliabce. More particularly, the ioveiitioD provides a method and apparatus for 
conveniebtly setting various progranunable feauires of an appliance using a graf^ical 
user inteilface accessed with a computer via a global computer network. 

2. Prio^art 

I 

Tiie advent of microprocessors and other miniaturized electronics has facilitated 
the implcjmentation of increasingly complex fuoctians in home and office appliances. 
Typical!]!, a relatively complex operator interface is required in order to invoke the 
various fpnctions that are available. For example, home electronic devices such as 
televisioiis, VCRs, stereo receivers and the like are typically provided with sophisticated 
remote control devices. Such remote control devices have a large number of individual 
bunons that are used to directly control features of an appliance and/or that are used to 
navigate through on-screen menus* Because of the sophistication and complexity of the 
controls, bwner^s manuals for appliances aie becoming increasingly voluminous and 
difficult t|[> comprehend. 
I 

to the growing complexity of mod^ appliances, many of the available 
features sire never utilized by cc»isumers, even as competidon in the maiketplace drives 
the proliferati<m of such featuies. A number of solutions have been proposed for 
making appliances easier to control and generally more ^'user fiiendly**. For example, 
U^. Patent No. 5,353,123 issued to Chan* et al. discloses a method for downloading 
set-up data via a telephone to an appliance controller. A user first initiates a telephone 
call to a remote site having a computer. The user communicates certain backgroond 
informatipn to the remote site, and set-up data is then downloaded via the telephone 
connection. The earpiece of the telephone is held in proximity to a mioophcme built 
into the aj)pliance controller in order to receive the downloaded data. Upon receipt of 
the data, ttie controller is configured to operate the appliance. 

i 

i 
j 

I 
I 
I 

I 
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fJ.S. Patent No. 5^600 Jll issued to Yuen discloses an apparatus and methods 
for providing initializing settings to an appliance. When a user wishes to initialize the 
settings bf an appliance, the user initiates a telephone connection with a remote $ite. 
The rem!ote site then downloads a sequence of commands for initiali2ing the settings in 
the appliance over the telephone connection. A remote control device for the appliance 
receives: the sequence of COTunands and stoi^es them in an internal memory. The lemote 
control device is then aimed at the appliance and the user enters a cormnand to transfer 
the sioreid sequence of conmiands to the aiq>liance, thereby initializing the settings. 

! 
I 

ID.S. Patent No. 5,141,756 issued to Levine discloses a method of initializing a 
prograin)tnab]e control device, such as a remote controller for a video cassette recorder. 
The device is programmed by connecting it to a telephone system, dialing a remote 
initializing center preferably en^loying a computer, and providing the computer with 
information as to the environment of the control device by using touch tone keys to 
respond to audio inquiries transmitted by the computer. The computer then transmits 
the initi^ilizing program for loading into the memoiy of the control device, 

l^.S. Patent No. 5^774,063 issued to Bany, et aL discloses a method and 
apparanis for remote control of dectronic devices from a con^uter. A transducer, such 
as an infrared transmitter, is coupled to a con^ter and aimed at an electronic device to 
be contr6lled. An application program running on the c<nnputer generates appropriate 
signals for control of the electronic device. 

Patent No. S»815,086 issued to Ivie, et al. discloses a method and ^paratm 
for comihunicating coomiands to dectrical appliances from remote locations. Various 
aj^liances within a strucmre, such as a bouse, are coupled to a signal-conducting bus, 
suchasthe AC powtf wiring bus of the structure. Appliance commands are issued over 
the bus from a central transmitter. Appliances may be direcdy coupled to the bus or 
may recejive commands via an infrared signal from an infrared transmitting device 
coupled to the bus« A handheld control device may be supplied for controlling the 
various 4)phances« in which case, receivers for the handheld conlrol device are coupled 
to the bus in various parts of the stracture. 

l);.S. Patent No. 5,819,294 issued to Oiambers discloses a programmable 
univeisalj remote controller. A programming device is coupled to a computer and 
receives ^ignals from conventional remote controllers. The progranrniing device 
correlate^ die received signals with a database of stored signals used by various 

I 
i 
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appliance manufactoim. The progranxming device then sends a complete set of 
approphstie control signals to the programmable universal controller 

i 

i 
I 

U[S. Patent No. 5^8,077 issued to Darbee discloses a universal remote 
controUei diat may be programmed from a remote location. The remote cootroller 
receives programming data via a video or teIq)honic data transmission system. 

UjS. Patent No. S»488»S71 issued to Jacobs, et al. discloses a system for 
transfeniiig data from a video display monitor of a personal computer to a portable 
informatibn device such as an appointment scheduling device. The video display is 
modulated to transmit data to an opto-electronjc receiver in tbe portable infonnation 
device. . 

Microsoft Cofporaiion has introduced a cordless phone having programmable 
functions jcontrolled by a personal computer. Tbe base station of the phone is coupled 
to the serisal pon of a computer and application software is installed on the con^>uter to 
control operation of tbe photte. 
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SUMMARY OF THE INVENTION 
the present invention provides methods and apparatus for setting preferences 
and oth* parameters of an appliance^ In preferred embodiments of the invention, a user 
initiates a connection to an inieractive site on a globa] computer network. Tbe site hosts 
a graphical user interface with which preferences and other parameters of an appliance 
may be set by the user. In some embodiments^ set-up data for the ^liance may be 
downloaSded directly to the appliance from the user's computer or the inteiactive site* In 
other emlKKliments, set--up data for tbe appliance is downloaded from the user's 
computer or the interactive site to a transfer device where it is tei^xsrarily stored. Tbe 
transfer device, which is easUy portable, is taken by the user to the appliance^ and the 
set-up data is downloaded from the transfer device to the appliance. Since the appliance 
itself does not require a user interface for set-up procedures and piogranmiing, the 
appliance can be smaller, cheaper and lighter without sacrificing any functionality. In 
additi(m»; the need for a printed user*s manual is largely obviated since aD of the 
infoimatton normally contained in such a manual can be obtained from the interactive 
site. I 

; 
f 

I 
* 
I 
* 

i 

! 
i 
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BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 is a functional block diagram of a first embodiment of tbe invention 
wherein an appliance receives data directly from a local computer. 

Figure 2 is a functional block diagram of a second embodiment of the invention 
wherein an appliance receives data from a local computer via a transfer device. 

Figure 3 is a functional block diagram of a transfer device as shown in Figure 

2. 

Figure 4 illustrates a graphical user interface suitable for setting programmable 
features of a tbennostat. 

Figure 5 is a functional block diagram of a third embodiment of the invention 
wherein an appliance receives data direcdy from an interactive site server. 

Figure 6 is a functional block diagram of a fourth embodonent of tbe invention 
wherein an appliance receives data from an interactive site server via a transfer device. 

Figure 7 illustrates limiinance modulation for tiansfevring decimal data digits* 

figure 8 illustrates luminance modulation with dithering encoding. 

Figure 9 illustrates limiinance modulation with iiregular graphic pat^nis. 

Figure 10 illustrates bi-color phase modulation. 

FIgpre 11 illustrates video barcode modulation. 

Figure 12 illustrates a self-clocking data encoding scheme for use with the 
present invendon. 

Figure 13 is a fhoctiMal block diagram of a receiving device suitable for use 
with the present invention. 

Figure 14 illustrates a display screen having a portion thereof for data transfer. 

Figure 15 is a plot of CRT pbotoresponse of a prototype system constructed in 
accordance with the present invention. 
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Figure 16 is a ploi of a calibration sequence used in the prototype system. 

Figure 17 illustrates an embodiment of the invention emplc^^ed to provide a 
visual index to the contents of a storage medium. 

Figures 18-20 illustrate the transfer of a virtual companion from a personal 
computer to a handheld device in accordance with an embodiment of the present 
invention. 



/ 
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nRTAii rn description of the invention 

. In the following description^ for purposes of explanation and not limitation, 
specific details are set forth in order to provide a tborougb uDdeistanding of the present 
invention. However, it will be apparent to one skilled in the ait that the present 
invention may be practiced in other embodiments that depart from these specific details. 
In other instances^ detailed descriptions of well-known methods and devices are omitted 
$0 as to not obscure the description of the present invention with unnecessary detail. 

The present invention finds application with a wide variety of home and office 
appliances. Some categories of appliances in which the invention may be utilized 
include clocks, telq)h<Hies, televisions, television $et--iop decoders, video recorders, 
audio and video entertainment system components, refrigerators^ conventional ovens« 
microwave ovens, disbwash^ irrigation systems, global positioning satellite (GPS) 
receivers, automobile heating, ventilating and air conditioning (HVAQ systems* 
automobile sound systems, home security systems, home HVAC systems, home master 
control systems, facsimile machines, copi^, cameras, postage meters» etc. 
-Programmable features" refer to any appliance features that may be altered. These 
include, for example, inidalizatioo or set-up parameters, stored data (e,g., telephone 
speed dial numbers or GPS receiver database) and intenial software. Specific examples 
are given below to illustrate operation of the invention. However* it will be understood 
that the invention has gen^ applicability to appliances of all types and to all types of 
programmable featurea widiin such appliances. 

The invention also has applicability apart fi:om setting progianmiable features of 
appliances. For example, the invention may be employed to purchase pay-per-view 
programming at an interactive web site. An authorization code may then be 
downloaded into the transfer device of the invention and transferred to a TV set^top box 
so that the purchased program will be ''descrambled^. This q)proach eliminates the 
telephone connection required for most TV set-top boxes v^tfa piay-per-view capability. 

Another potential application for the invention is as a programmable ''token** 
which may be used to fadlitate a wide variety of transactions. For example^ a consumer 
product manufactmer may ofiFer discounts on certain of its products at its web site. 
Authorization to receive the discount may be downloaded into the transfer device of the 
invendon and the transfer device may then be taken to a retailer. The transfer device is 
then used to oansmit the discount authcxization to a receiving terminal at the retailer. 
Ideally, the teiminal would also have the ability to modify the stored conteuKS of the 
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transfer device so that the discount authorization cooJd be cancelled once the discount is 
given. This same *1oken'' approach can also be applied to pre-paid purchase 
transactions; reservations at restaurants, hotels, paries, etc.; entry authorization 10 
eniertaimnem venues or other secured areas and similar situations in which a 
conveniently transported authorizing token serves as an extended communication lirik 
from a computer system. 

1. Specific Embodiments of the Invention 

A first embodiment of the invention is illustrated in Figure 1« An appliance 10 
receives set-^up data from a local computer 12. In a typical application, local compute 
12 is a general purpose personal computer of the type now widely found in homes and 
offices. Details of computer 12 are not particularly relevant to the invention and arc not 
shown. Topically, computer 12 will comprise, at a minimum, a processing unit, a 
keyboard and a display* Additional input devices, such as a mouse or other pointing 
device^ and output devices, such as a printer, may also be included as part of computer 
12. 

Local computer 12 is coupled to a remote interactive site server 14 by a 
telecommunications link. In a typical embodiment of die invention, int^activc site 
server 14 wwild be accessible via the World Wide Web. Odier appropriate means for 
connecting computer 12 to server 14 cotild also be employed. Server 14 contains 
programming for interactively setting the programmable features of appliance 10. 
Preferably, s^ver 14 irosents to the owner of appliance 10, via computer 12, a 
graphical user inter&ce that is tailored to appliance 10 and the j»x)gramroable features 
thereof. Such inter^Eice can be thought of as a 'Virtual appliance". Iliis can be better 
understood from the discusrion of I>1giire 4, below. 

In the embodiment illustrated in Figure 1, ^pliance 10 is coupled directly to 
local computer 12. Iliis embodiment is best suited for portable appliances that may be 
conveniently carried to the computer for set-up. Hie coupling between appliance 10 
and computer 12 may be one-way from the computer or two-way. One-way 
communication may be accomplished optically by providing appliance 10 with an 
optical sensor and modulating ihe display of computer 12 utilizing one or moi^ of the 
techniques described below. Other communication techniques can be enq>Ioyed using 
audio, magnetic, inductive, infrared, or radio frequency coupling. Two-way 
conmiunicadons are most conveniently established by connection to a serial port of 
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computer 12. Naturally^ this type of connection is not convenient for some appliances, 
but is particularly well-suited to portable appliances that may require a large amount of 
data. For example^ loading data into a pocket organizer or similar type of personal 
digital assistant can be most conveniently accomplished with a serial port coiuiection in 
the configuraticMi iDusirated in Figure 1. 

Some types of appliances can be readily adapted to utilize existii^g components 
for establishing communications with computer 12. For example, electronic cameras 
inherently possess optical sensors that can be used to sense modulation of a computer 
display scte^ or other light source. The primary imaging path of the camera may be 
used in the case of video cameras and digital still cameras. TUs simply requires the 
addition of ciicuitiy and/or software to decode the modulation ^d store the appropriate 
setmp parameters. Alternatively, the receiver of the camera* s focusing range finder 
may be used as the optical sensor. 

In order to provide the ^ipropriate interface for progranrniing the features of 
appliance 10, server 14 preferably receives data from the alliance manufacturer. Such 
data may be received periodically as new model appliances are released by the 
manufocturer or may be obtained by server 14 in real time with a dialnip ctnmection to 
the manufaetuier. The latter approach offers the advantage of insuring that the most 
recent product information is available to server 14. One method of insuring that the 
appropriate information for aj^liance 10 is obtained by server 14 is to prompt the 
appliance owner to input the s^ial number of the appliance at computer 12. This need 
only be perfmned once, since the serial number can thereafter be stored in computer 12 
aiui/or server 14 for use in subsequent progranrniing of the same appliance. Warranty 
registration for the appliance may be conveniently p erf or med during this same 
procedure. 

An optional aspect of the invention is the ability of server 14 to provide valuable 
feedbadc to the appliance manufacturer^ During appliarK:e set-up operations^ server 14 
collects information concerning consumer's use of product features Azi can be useful in 
product marketing and new product design. The link between sender 14 and the 
appliance manufacturer also facilitates new marketing opportunities. The manufacturer 
can readily target advertising to identified purchasers of its products, AlsOt the 
manufacnirer can offer accessones and related products for appliance 10. Such offers 
may be integrated with the set-up interface or may be directed to tiie iqypliance owner 
separately by email or conventional inafl. It should be appreciated that the invention 
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can facilitate warranty registration. Since the appliance owner is already 
communicating with server 14 to set programmable feaiures of the appliance* it is a 
simple matter to collect the additional information necessary to complete warranty 
registration and, if desired, to provide additional demographic data to the manufaaorer. 

Figure 2 illustrates an alternative embodiment of the invention. Tbis 
embodiment is similar to that of Figure 1, except that prognunming data is provided to 
appliance 10 by a transfer device 16. This transfer device receives the {N^ogramming 
data from local computer 12 by a wired connection to computer 12 or, preferably, by an 
opto-clectronic or other wireless data link such as will be desciibed more ftdly below. 

Figure 3 is a functional block diagram of a suitable transfer device 16. At the 
heait of device 16 is a control electronics module 102« Data modulated on the display 
screen of computer 12 is sensed by optical detector 104 upon activation of receive 
switch 106* The data is demodulated by electronics 102 and is stored in noemory 108. 
Upon confirmation of eiror-fiee transfer and storage of the data, a suitable indication is 
(xovided to the user by means of indicator 110» which may be, for example, a light 
emitting diode (LED). With the data loaded in memory 108» transfer device 16 may be 
canxed to appliance 10, which preferably includes a "docking" port for transfer device 
16. Transfer device 16 may be an integral component of appliance 10, which is 
provided to the consumer by the appliance manufacturer. Alternatively, appliance 10 
may be provided with an infrared receiver coupled to its internal control electronics. In 
the case of an IR link, transfer device 16 is held in proximity to the infrared receiver of 
appliance 10. Upon actuation of transmit switch 112, the data stored in memory 108 is 
appropriately modulated by dectronics 102 and applied to infrared transmitter 114. 
Indicator 110 may confirm to die u$er that the data has been transmitted. Alternatively, 
or in addition, an indicator may be provided on appliance 10 to signal receipt of the 
data. Power source 116, preferably in the fomi of common alkaline batteiy cells, 
provides electrical power to the components of device 16. 

Transfer device 16 may be configured to transfer data finom the appUance back to 
the computer as welL Data from the appliance may be loaded into the transfer device 
by means of an (^to-electionic link in the same manner by which data is loaded from 
the conqniter. Pr^erably, however, the tmisfet device will have a direct electrical 
coupling to the appliance for applications involving 2-way conuminications. Transfer 
of data into the computer may be accomplished in a number of ways. For example, 
transfer device 16 may couple directly to a soial or parallel input port of the ccmtputer. 
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Alternatively, transfer device 16 may include a sound transducer by which data may be 
transferred through a microphoiie coupled to the computer. 

Transfer device 16 may be configured in various forms. Piefdrably^ device 16 is 
easily portable. Device 16 may be in the form of a pen or wand with optical deteaor 
104 and infirared transmitter 114 at one end. Transfer device 16 may also be integrated 
with a conventional remote controller for those types of appliances that are commonly 
conuolled remotely. In another variation, transfer device 16 may be a removable 
module that is docked into appliance 10 as desoibed above. In such case, 
communication between the transfer device and the appliance may be accomplished 
with a direct electrical coimection through a suitable arrangement of electrical contacts. 
Transfer device 16 may« in foct, comprise the ^'brains*^ of appliance 10 in the form of a 
microprocessor or equivalent device. Aside firom the ease of pmgramming features and 
functions of the appliance, such an arrangement offers the added benefit of facilitating 
service en* replacement of the iqppUance*s electronic components in the event of 
malfunction. 

The embodiment shown in Figures 2 and 3 is particularly well-suited to 
appliances that arc relatively fixed in position and that require only limited amoimts of 
data. Examples of such appliances abound in the borne and ofiioe. One snch e^iample 
is a thermostat for a home HVAC system. Figure 4 iUusirates a graphical user interface 
for a thermostat as presented on a display of computer 12. Such interface is shown 
merely for purposes of illustration, it being understood that the particular features of the 
interface are largely a matter of design choice. The graphical user interface is 
sometimes referred to as a '•virtual appliance" (a virtual thermostat in this specific 
example). This does not imply that the interface physically resembles the real 
appliance, but rather that the interface permits access, via the user's computer^ to the 
programmable feamres of the real appliance. 

Along the top of the display shown in Figure 4 is a day strip 122. The user may 
select any one of the days with a cursor to program the thermostat settings for that day. 
Below the day strip is a temperature selector 124. Pointing at the 19 or down arrow 
with a mouse or other cursor positioning device, the ua^ selects the desired 
temperature. To the right of temperature selector 124 there are a pair of time windows 
126 and 128. Using the appn^ate up and down arrows, the user selects the starting 
and ending times for which the temperature selection qyplies. When the desired settings 
have been made* the user selects ENTER button 130 to store the selections and then 
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proceeds to make the next set of selections. For convenience> the ending time last 
entered may be automatically inserted into the starting time window. A graphjcal 
display 132 of the selected temperature profile may be provided for the user'$ 
convenience. 

When all settings have been completed, the data is loaded into transfer device 
16, which is then taken to the physical location of the Aermostat for transfer of the data. 
Since all of the settings have been entered into computer 12, they may be conveniently 
saved locally and/or by server 14 for subs^uent use in revising these settings or for 
reloading the settings in the event of a power failure* A printed record of the settings 
may also be made from computer 12. For some aj^liances^ 3 print-out following a set- 
up procedure may be used as a template for the q)pliance to indicate selected options 
and programmed features. For exanq^le, certain appliances may have unlabded 
function buttons for which a template may be made once selected functions have been 
assigned to the buttons during a set-up procedure. 

It will be appreciated that a thermostat physically incorporating the interface 
shown in Figure 4 would be quite large and costly in comparison to conventional 
thermostats. This is due primarily to the relative complexity of the interface^ since the 
acnial componentry to provide such flexibility of thennostat settings is actuaUy quite 
small and inexpensive^ Huougb use of the present invention, virtually unlimiied 
flexibility in thermostat programmiiig may be accomplished with a thermostat that is no 
larger and no more costly than a conventional thermostaL Indeed, a thermostat as just 
described could easily be made the size of aposiage stanqp. 

Figure 5 iOustrates another alteniative nabodiment of the invention. In this 
case, data f<w appliance 10 is received directly from server 14 rather than local computer 
12. From the appliance owner^s perspective^ the appliance programming interface is 
otherwise identical to the previously described embodiments. Communication between 
server 14 and q)pliance 10 may be telephonic. Appliance 10 may incorporate a 
conventional modem, in which case conmiunications may be two-way, or may simply 
have a data demodulator for one-way communications. Coupling of appliance 10 to the 
telecotrununications network may be by a conventional RJ-1 1 coiuiection. 
Alternatively, ^pliance 10 may incori)orate a cordless telephone module for 
communicating with a sqiarate base station. Coirmiunications between server 14 and 
appliance 10 could also be implemented with radio signals. For example^ ^liance 10 
could incorporate a conventional paging receiver. 
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A particular example of the embodiment Ulustrated in Figure 5 is a 
programmable telephone. Speed dial Aumbers and other progiammable featni^ of a 
telephone may be conveniently set using a graphical user interface liosted by server 14. 
Once the features have been programmed by the user» server 14 simply places a call to 
the telephone. Appropriate data demodulation circuitry is incorporated in the telephone 
in order to download the data from .server 14. 

Figure 6 illustrates a further embodiment of the invention generally similar to 
that of Figure 5, but incorporating a transfer device as in the embodiment of Figure 2. 
Here, however, transfer device 16' receives data directly irom server 14. As with die 
previously described embodiment, communication between server 14 and transfer 
device 16' may be telephonic or by radio. One example of a transfer device 16' is 
embodied as a removable module or "card" of a telephone. Data for an appliance 10 is 
downloaded from server 14 to the telephone where it is demodulated and stored in the 
card. The card may then be takai to appliance 10 to transfer the data to the appliance 
with an Infrared or other data link* 

Another embodiment of the invention as illustrated in Figure 6 is a '^universal** 
remote controller that may be coupled to a telecommunications network by means of an 
RJ-1 1 jack or equivalent in the manner disclosed by Daibee in U.S. Patent No. 
5,228,077. TTie remote controller could thus function as a data transfer device in 
addition to its more conventional remote control functions. 

As discussed above, die transfer device or q>pliance of die present invention 
preferably receives data by means of an opto-electronic data link. Any suitable source 
of light modulation may be en^loyed to transmit data to the transfer device or 
appliance. These include USDs, incandescent bulbs, LCDs and CaiTs. A convenient 
source of Ught modulation is the display screen of a local computer. At least a portion 
of the display of the local computer may be modulated to transmit data to the transfer 
device. 

Most current approaches to video modulation data transfer use sequential 
pulsing of the video image to provide a series of binary 1 *s and 0*s. TTiese binary hits 
are used with frammg bits (start and stop bits) to form complete data bytes. Some of 
the current approaches rely on the scanning CRT image to serialize tte data bits by 
providing a hjminance pulse for each data bit This approach will fail when applied to 
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flat panel LCD screens because these screens do not have a scanmng lominance 
response like that found with the CRT. 

Other methods provide a binary bit stream where each bit is produced at the 
video field rate. For a typical CRT, this provides one binaiy data bit each 16 msec. (60 
Gelds per second). While this q>pioacb is viable for the CRT, it will not work well fi^ 
flat panel displays. The slow response time of LCD panels mean that only a small 
number of data bits could be transferred per second. For a passive display, 3 bits would 
be possible (assuming 300 msec, response rime). For active panels* 20 bits could be 
transferred. Using conventional start and stop bits, a passive panel would then be 
capable of transmitting 0.3 bytes per second and active panels 2 bytes per second. This 
is too low a data rate for many applications. 

Various modulation schemes are proposed below that are suitable for use with 
both CRT and LCD displays. Transmission of data from a remote server through a 
user's compute may be implemented widi an appropriate applet written, for example, in 
the )ava programming language. 

2. LUMINANCE Modulation 

A first approach to data modulation of a disjday screen employs luminance 
modulation. This method drives the display with varying levels of intensity. Each 
intensity level can represent an entire data digit For example. Figure 7 illustrates a 
method using 10 shades of gray to represent a decimal digit. The himinance level for 
each successive decimal digit or luminance '*dweir is generated as fast as the display 
can accommodate. For an active matrix LCD panel, 20 dwells could be seat in one 
second. This allows 20 digits of informauoQ per second, which is substantially faster 
than sending binary data. Higher data rates are possible with CRT displays, which arc 
capable of transmitting a decimal digit in each video fidd 

The luminance levels are detected by a photodetector in a receiving device. 
Discrete luminance levels can be generated using several different methods: 

a) Grayscales 

This method drives a spot on the display to one of several discrete shades of gray. 
The photodetector in the receiving device can detect the discrete levels and convert each 
level into a single digit value. Reference levels can also be sent periodically in the data 
stream to establish the black and white (highest / lowest) luminance levels. This allows 
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the photodetector output to be scaled to more accurately detect each discrete gray level. 
One limitation to this method is that the gray scale response of the display may not be 
linear. In fact, gray scale levels are greatly affected by the monitor's contrast and 
brightness controls. These controls can be changed by the user and are not predictable 
or known constants. 

b) Chromatic luminaiice 

It is possible to convey various luminance levels by selecting different color 
combinations. Each color has a Iimiinance component combined with a chroma 
component. Selecting different colors also selects different hmunancc levels. For 
exanqile, dark brown has a low luminance while cyan has a high luminance. Note that 
what is being detected with this method is luminance - not color. Accurate luminance 
detection depends on the ccdor response of the display, the monitor contrast, brightness 
and color settings, and the color response characterisdcs of the photodetector. Accurate 
detection usmg this method typically requires some form of calibration to match the 
photodetector le^Kmse to the display color response. 

c) Dithering 

With reference to Figure the cmrently prefmed method diq>]ays a regular 
pattern of black and white pixels within a region of the display to produce an average 
luminance level. This ^dithering'^ average level is created fay dividing the entire 
detection region into a matrix of smaller discrete cells conq>rising one or nvore pixels. 
Each cell is either driven full white or Aill black. The ratio of black to white cells 
determines the oveiall, av^age luminance for the detection area. This method 
eliminates problems with unpredictable gray scale response in the display doe to 
contrast or brightness settings. 

The dithering approach illustrated in Figure 8 uses a rectangular matrix to 
obtain an average luminance for a given area. It is also possible to display other graphic 
patterns or characters which have a distinctive appearance while also presenting an 
average overall luminance. Some exan^les are shown in Figure 9. Each of these have 
a unique lummance level when the black areas are averaged with the white background. 
This allows the photodetector to discriminate between unique patterns or characters to 
convert to a conesponding data value. 
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d) MulU-color modolation 

Anoth^ mecbod is lo u$e iwo or mart color channels to provide a means of data 
moduladon. For tbis method two or more photodetectors are used, each responsive to 
different portions of the color spectrum. For example* separate red and green 
photodetectors could be used to detect vaiying shades of each color. Using two 
channels allovvs data encoding using the luminance level of each color channel, or the 
phase between two color signals. Phase modulation worics by modulating the color 
channels at a given rate, but varying the phase relationship between the two channels as 
shown in Figure 10. 

To further increase the data density, it is possible to c(»nbine modulation of 
color luminance with color irfiase. Thus at any given sample interval, three parametexs 
are available: red intenaity, green intensity and {diase relationship. If eight discrete 
values of each parameter are used, each sample point can represent 8' values or 1 of 512 
discrete numerical values per sample, A disadvantage lo this method is the requirement 
for two color-selective detectors. Also, color response can vary between displays, so 
some type of color calibration may be required. 

X Video Bar Code 

Figure 11 illnstrates another method of data encoding using video bar code 
modulation. This approach is similar to printed bar codes, but uses a higher density data 
coding. With this method, a video bar code is displayed across the screen. The user 
swipes a receiving device across the bar code to read data from the screen. Conventional 
printed bar exudes work by using different spaces between vertical lines* The spacing 
relationship is translated into binary data bits. Multiple bits are combined to form bytes 
of data. 

Using a video image^ data can be represented using luminance levels or color. 
This allows higher data density because each *%3f" in the video bar code can represent 
an entire decimal digit instead of just a single binary biL This increases data density by 
8 to 10 times compared to conventional bar codes. 

Figure 11 illustrates a video bar code using luminance levels. Note that 
luminance levels can be generated using the same methods as previously described for 
spot modulation. Each bar represents one of many luminance levels, for example, with 
10 luminance levels each bar can represent a digit value of 0 to 9. 
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4. Color Modulation 

Chromatic luminance modulation was described above as a fonn of intensity 
modulation* It is also possible to employ a true color modulation in which speciflc 
color hues are used to represent corresponding numerical values. Depending on the 
Faage of hues used, an array of two or three separate detectors sensitive to different 
spectral components, such as by using appropriate filters, is required. A beam splitter 
may be en^Ioyed to direct light to the individual detectors of the array in the receiving 
device. 

5. SELF Clocking 

Regardless of the method of modulaiion employed, it is desirable that the data 
transmission be selfnidocking. This means that individual data characters are detected 
by die receiving device without precise time spacing between characters. This self- 
clocking approach allows for pauses to occur during the transmission of data characters 
without creating transmission errors. Pauses can occur in PCs if the operating system 
performs another task while the transmission is active. Forejcaniplei imiltitasking 
operating systems will commonly write data between memory cache storage and disk 
drives. This activity can preempt the operation of other software and cause short pauses 
in the operation of lower level applications. For internet based data transfers, varyiag 
delays are also common when moving data between servers and client PCs. 

It is also important to accommodate different data rates depending on the type of 
display monitor being used. Prior to starting the data transfer, the user can make a 
selection to indicate the type of display being used. If the display is a CRT, a faster 
transfer rate may be used (up to 75 digits per second). If an active matrix display is 
being used the transfer rate will be slower (20 digits per second). While the selection of 
transfer rate is easily accomplished on the PC side, the receiving device will preferably 
be compatible with all avaUable transfer rates. Using self clocking data allows the 
receiving device to receive data at the transmission rate, without the need for a ^latn ^te 
selection on the receiving device itself. 

An efficient self-clocking method using a oon-binary data encoding is illustrated 
in Figure 12. If luminance modulation is used the receiving device can detect each 
discrete lu m inance level change as a new digit The length of time between successive 
digits is inelevant If the same digit value is sent twice in succession, a special *^epeat** 
characttf can be used to mdicate that die last digit value is repeating. As shown in 
Figure 12, indicates a repeatmg digit value. If the data stream the nunierical value 
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1223, ihis would be transmitted as 1 2 > 3. More than two repeating digits are handled 
by resending the digit again after the repeal character. Thus, 122223 would be sent as 1 
2>2>3. With this approach a single digii value is never repeated twice in succession. 
The detector can simply wail for each change in luminance level to indicate a new digit 
value has been sent. Timing relationships between characters is not significant 

A self-<:locking data interface in accordance with the present invention 
preferably uses a base 12 encoding system comprising decimal values 0-9, the rq>eat 
character * V and a character to designate the end of a data recoid. Using this 
system* a sequence of decimal values of arbitrary length can be transfeired using. e.g,, 
twelve intensity levels. Alphanumeric data may be transferred using double digit 
values, each pair of digits representing the ASCII or equivalent code for an 
alphanumeric character. 

6. Time Interval Modulation 

In contrast to self-clocking methods, another modulation approach is based on 
the time spacing between changes in intensity level or color. With ttiis approach, only a 
limited number of intensity levels or colors is required. The number of discrete 
intensity levels or colore may be as few as two. The time interval between changes in 
intensity level or color has a nuniber of possible discrete values, each of which 
corresponds to a numerical vahie. A significant advantage of this approach is that it is 
not sensitive to variations m display intensity or color fidelity. However, due to Oie 
characterisdc response times, this approach is better suited to CRT displays than to LCD 
displays* 

7. Receiving Device 

Figure 13 is a block diagram of a receiving device 200 suitable for use in 
connection with the present invention. Light emitted by (or reflected by) a display 
screen falls on photodetector 202. The output of the photodetector is amplified by 
amplifier 204 and asseited at the input of the analog-tcMligital (A/D) craveiter 206. 
The digitized output, in this case conqjrising an 8-bit word, is presented as an input to 
microcontroller 208. The operation of microcontroller 208 is controlled by program 
instractions stored in read c»ily memory (ROM) 210. These instructions govern the 
conversion of the raw digitized input from A/D converter 206 into a data digit The data 
digits are fiutber processed in accordance with the particular functions to be 
accomplished by receiving device 200. When configured as a transf^ device, such as 
transfer device 16 discussed previously^ reoeivhig device 200 will further coimnunicaie 
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the data digits or information derived therefrom to a host device via a wired or wireless 
imerfece. A random access memory (RAM) 212 is coupled to microconironer 208 for 
use as a scratchpad memoiy, the use of which may include temporary storage of Uie data 
digits received from A/D converter 206 or information derived Iherefiom. In many 
applications, particularly those related to transaction processing, leceiving device 200 
will include a user interface 214 comprising a display and/or various controls, such as 
function selection buttons and che like. Receiving device 200 may also include a 
provision to allow for automatic calibration of the analog to digital converter. A peak 
detector 216 detects the peak white level in the received signal. This level is used to 
estabBsh the upper range of A/D convener 206. This aUows the fuU range of the A/D 
converter to be used over the receiver's data detection range. 

Receiving device 200 may be configured in any convenient form. As discussed 
above in connection with transfer device 16, receiving device 200 may have an 
elongated cylindrical shape similar to a pen or a wand. In such case, photodetector 202 
may be convcaiiently located at one end of the device. However, it has been found that 
pea- or wand-shq>ed devices have disadvantages when used with LCD flat screen 
di^lays. If the device is pressed against the display, even with Ught pressure, the 
display may be distorted, thereby aifecting the accuracy of the data transfer. For flat 
panel displays, a flat, card-shaped receiving device is prefcned. Such a device may be 
hek) against the display screen without distnting the display. 

To ensure proper registration of the receiving device with the display screen, a 
visual indication of the area of the display screen that wiU contain the data modulation 
is preferably provided. As shown in Figare 14, a rectangular area of the display screen, 
generally corresponding in size and shape to the card-shaped receiving device, nuy be 
configured as a window and may be labeled with a legend such as "place card here". A 
progress bar may be displayed adjacent to the transmission area to indicate the status of 
data transmission. 

In the examples discussed above, a single photodetector (or paired detectors in 
Qm ease of bi-color modulatica) is used in combination with a dngle modulated regi<m 
of the display screen. It will be appreciated diat the data transfer rate can be multiplied 
by employing a suitable array of photodetectors in comhioation with a conespondiog 
array of data transmission regions. Obviously, the array of detectors must be property 
registered with the army of modulated regions on the display. Tliis can present a 
chaHenge in the case of a handheld receiving device. One solution to this challenge is 
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illustrated in Figure 14. Here, the display is divided into four quadrants chat are 
indq)endently modulated. The receiving device includes an ajray of four independent 
photodetectors. By providing simple registration maiks on both the di^lay screen and 
the receiving device, the receiving device can be held against the display screen so that 
the photodetectors are in proper registration with the coirespondihg quadrants. 

8. EXPERIMENTAL Results 

A prototype system has been constructed. The prototype receiving device is 
configured as a card having the same length and width as a standard credit card. A 9 
mm round pbotodetector elenient is located in the center of one face of the canl 
Electromc circuitry widiin the card amplifies the oatjmi signal of the pbotodetector, 
which is then applied as an analog input to a conventional personal computer system 
where A/D conversion is performed. The pbotodetector element is designed to detect 
the average luminance over a 9 mm round area of the display screen. The detector 
consists of a u^nslucent glass window and a photo^Darlington transistor pbotodeteaor 
mounted in a plastic enclosure. 

The prototype system employs luminance rnoduladon using the dithering 
approach discussed above. A total of 12 hjminaooe levels are used to represent ten 
decimal values plus two additional values to indicate formatting and repeating 
characters. Using a CRT display, the prototype systrai has achieved data transfer rates 
of 20 characters per second. 

The pbotodetector in the receiver detects die Iimilnance change as the electron 
beam io the CRT passes over the detector. Ibis screen phosphor glows with a 
brigbmess related to the average screen luminance. F6r a CRT display, the beam is 
constantly scanning the screen. This creates a pulse as the beam passes over the 
detector. Therefore^ the signal detected is a pulse which repeats at the frame rate of the 
display (typically 13 to 17 msec, per field). Figure 15 is an actual capture of Ae signal 
received by the detector using a CRT-based display. 

Since the received signal is a pulse, a software algorithm processes the A/D 
conversion readings in order to establish the luminance level rqmsented by the peaks 
of die detected pulses. The software algorithm is then capable of decoding these levels 
back into packets of data. 
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It is desirable for the system to auiomaiicaliy adapt to varying intensity levels on 
the display. Different luminance levels will result due to variances in the brightness 
response of the display, the sensitivity characteristics of the phoCodetector and also due 
to adjustment of the brightness and contrast settings of the monitor. 

To automatically adjust for these differences^ the system provides a calibration 
sequence at the start of each data transmission. As illustrated in Figare 16, the 
calibration pattern consists of a staircase of each of the 12 luminance levels used. A fiill 
wMte pulse Qevel 12) is sent at the start of the sequence, followed by vahies of 0 to 12. 
This signal is detected by the xeceiver and used to establish the acmal 12 discrete levels 
obtained from the monitor. In Figure 16, the bottom signal is the actual pulse 
wavefonn received by the phocodetector. The top signal is that obtained after 
processing by a software algoriduu- 

9. Further embodiments of the invenhon 

Another specific example of the utility of the present invention is illustrated in 
Figure 17. A transfer device 300 Is essentially similar to device 200 described above. 
Data is transfmed into device 300 from a local computer 302 as previously discussed. 
In this case, device 300 is loaded with information describing the contents recorded on a 
storage medium, such as videotape cassette 304. The infoimatioii loaded into device 
300 may be inputted direcUy by die user at the local computer. Preferably, however, an 
interactive television program guide is employed so that the user can singly "^int and 
click" on the particular programs lhat have beep recorded. 

Transfer device 300 is then docked into videotape cassette 304, A display 306 is 
then employed to provide a visual index to the contents of cassette 304. Alt^natively, a 
display 308 may be built into cassette 304. in which case transfer device 300 need not 
include display 306. In this case, the informatiOT describing the contents of cassette 304 
may be stored within the cassette itself so that die transfer device may be used to load 
information into a plurality of cassettes. 

Still another example of the utility of the present invention is shown in Figures 
18-20. Figure 18 illustrates a virmal companion 410 ^peaxing on the display screen 
412 of a perscHial computer system. Vhrtual companion 410 may be created by a 
software program running on flie computer system. Such software may be purchased 
and installed using conventional magnetic disks or a CD-ROM. Tlie software may also 
be downloaded ffom a remote site. Aliemadvely^ virtual companion 410 may be 
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generated by a software program on a remote server that is accessed by the personal 
computer system via the worid wide web. The virtual companion may resemble a pet 
animal, a commeicial doll or stuffed toy, a character fix>m a bodk or comic strip, an 
historical figure, a spoits peiKNiality, etc,. Preferably, certain attributes of the virtual 
companion, such as the companion's name, limited aspects of appearance^ dresSt voice 
and spoken phrases may be customized by the user with appropriate control panels and 
the like on the personal computer system. 

An integral part of the invention is handheld device 420. This device would be 
purchased by the user in conjunction with software for the personal computer system or 
with a password to a corresponding web site. Once the virtual companion has been 
configured according to the user's wishes, it may be 'transpcxted'' from display .screen 
412 to device 420. To accomplish this, the user initiates a transfer by clicking on a 
transfer icon 414 on display screen 412 or by other suitable input means. The user is 
then instructed to place device 420 over a location 416 on display screen 412. 

Referring now to Flgare 19, virtual companion 410 appears on display screen 
422 of device 420 when the transfer is completed. Aiqpropriate sound effects may be 
generated by the computer system during the transfer process. Virtual companion 410 
no longer appears on display screen 412 of die computer system. As indicated in 
Figure 20, device 420 may now be removed from display screm 412 and carried about 
with viitual companion 410 "^resident" therein. 

Software installed in device 420 controls viitual conipanion 410 while it is in 
"residence''. Such software would include at least a limited capability for animating 
virtisal companion 410 and for enabling it to articalate words and/or sounds. The 
maimer in which virtual companion 410 is controlled may be downloaded into device 
420 as part of the transfer process. 

When desired, virtual companion 410 may be returned to di^lay screen 412. 
This transfin' may again be initiated by cHcktng on an icoo on the display screen or by 
other suitable input means. It is possible to achieve this transfer even if there is only 
one*way communication from display screen 412 to device 420. When the transfer is 
initiated, data is sent from display screen 412 to device 420 to cause virtual companim 
410 to be removed from display screen 422. Simultaneously, virtual companion 410 
spears on display screen 412. However, if device 420 is not properly aligned with 
location 416 on display screen 412, viitual companion 410 may appear on display 
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screen 412. even though it is not removed frou) display screen 422, Therefore^ is may 
be preferable to implement at least limited two-way communications between device 
420 and the personal computer system. One way of providing communication from 
device 420 to the computer system Is via an audible signal bom device 420 that is 
received by a microphone in the computer system. Alternatively, .a wired interface to a 
microphone input jack or other input port of the computer system may be used. 

A variety of interactive activiiies may be constructed around the virtual 
companion. For example^ the virtual conipanion may be a participant in a game played 
on the personal computer system. The virtual companion may then be transferred to 
device 420 as a means of escape torn some danger, for transport to a different time or 
place in the stoiy line of the game, for "regeneration" or the like. Virtual companions 
may even be transferred between users. Thus, one user may "send** his virtual 
companion to a friend, who can then mteract with the virtual companion and transfer it 
to her own device 420. 

Apart fifom providing a portable "habitaf* for a virtual companion, device 420 
may have additional play value. For example, device 420 can serve as a readout device 
for text messages that are sent from display screen 412 using the data transfer protocol 
of this invention. Device 420 dius acts as a "decoder^ for otherwise unintdligible 
messages. 

It will be recognized that the above-described invention may be embodied in 
other specific forms witiiom departing from the spirit or essential characteristics of die 
disclosure. Thus, it is understood that the invention is not to be limited by the foregoing 
illustrative details, but rather is to be defined by the appended claims. 
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CLAIMS 

WHAT IS CLAIMED IS: 



1. A method for setting programmabie features of an ^ 
the steps of: 

providing interactive site on a global computer netwoik; 
establishing a connection with the interactive site; 
interactively setting prognunmable features of a virtual appliance at iht 
interactive site; 

piovidiog a transfer device sqtarate from the user's computer having an 
input port and an outpot poit; 

downloading set-up data from Oie intera[ctive site to the input port of the 
transfer device; 

downloading the set-xtp data from the output part of the transfer device to 
a real appliance corresponding to the viitual appliance. 

2- The method of claim 1 wherein the input port of the transfer device 
comprises an optical sensor, 

3. The method of claim 2 wherein ihe step of downloading set-up data from 
the interactive site to the input poit of the transfer device comprises modulating a 
portion of a display screen and sensing such modulation with the optical sensor. 

4. The method of claim 3 wherein the step of modulating the display screen 
comprises displaying varying shades of gray. 

5. The method of claim 3 wherein the step of modulating tlie display screen 
coro]vises displaying varying colors. 

6. The method of claim 3 wherein the step of modulating the display screen 
comprises displaying varying pattmis of black and white pixels. 

7. The method of claim 6 wherein the pattern conqxises a regular pattCTi of 

cells. 
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8. The method of claim 6 wherein the pattern comprises an irregular 
graphic partem. 

9. The method of claim 6 wherein the patterns of black and white pixels 
have a plurality of average intensity levels greater than two such that each of the 
patterns represents a corresponding data digjt having a numerical base greater than two* 

10. The method of claim 1 wherein the output port of the transfer device 
comprises an infra-red transmitter. 

1 1. The method of claim 1 wherein the step of downloading set-up data from 
the interactive site to the input port of the transfer device comprises downloading the 
set-up data to a computer coupled to the input port of the transfer device. 

12. The method of claim 1 further comprising the steps of extracting 
information from the set-up data and sending said information to a manufacturer of the 
leal appliance. 

13. A method for setting programmable features of an appliance comprising 
the steps of: 

providing an interactive site on a global computer network; 
establishing a connection between a user*s computer and the interactive 

site; 

interactively setting programmable features of a virtual qyplianoe at the 
interactive site; 

establishing a direct communicaticm link between the interactive site and 
a real appliance corresponding to the virtual appliance, said communication link 
being independent of the user*s computer; 

downloading set-up data from the interactive site to the real appliance. 

14. The method of claim 13 wherein the communication link is telephonic. 

15. The method of claim 13 wherein the communicadon link comprises a 
radio frequency link. 
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16. A method for setting programmable features of a telephone comprising 
the steps of: 

{M-oviding an interactive site on a global computer necwc^; 
establishing a connection between a user's computer and the interactive 

site; 

interactively setting programmable features of a virtual telephone at the 
interactive site; 

providing a real te]q>boiie cone^nding to the virtual telephone having 
a data decoder for decoding data transmitted tdephonically; 

the interactive site establishing a direct telq)hO!nic connection with the 
real telephone independent of the user's computer; 

telephonically downloading set-up data from the interactive site to the 
real telephone. 

17. An interface device for communicating data to an appliance con^msing: 
means for coupling the inteifioe device to a global computer network to 

receive modulated data; 
a data demodulator; 

a data memory coupled to the data demodiilator; 
a data output port coupled to the data memory; 
control means for initiating ttansfer of data from the dau memory to an 
appliance via the output port. 

18. The apparatus of claim 17 wherein the means for coupling the interface 
device to the global computer network comprises means for modtilating a display soeen 
of a local computer. 

19. The apparatus of claim 17 wheitein the means for coupling the interface 
device to the global computer netwoik comprises a telephonic craneoion. 

20. The apparatus of claim 17 whoein the interface device is a removable 
module of the appliance. 

21. The apparatus of claim 20 wherein the interface device comprises 
electronics for controlling the appliance during operation thereof 
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22. An apparatus comprising: 

a computer having means for executing a first stored program and a 
display screen; 

means for wireless transmission of data from the computer; 

a handheld device having means for receiving said wireless transmission 
of data, means for executing a second stored program and a display screen; 

wherein said first stored program controls displays of an icon on the 
computer display screen and causes said icon to be removed from the computer 
display screen in associate with wireless transmission of first data; and 

where in said second stored program causes said icon to appear on the 
handheld device display screen in association with receipt of said first data. 

23. The apparatus of claim 22 wherexQ the means for wireless transmission 
oompxises modulation of at least a pMion of the computer display screen. 

24. A method of providing an interactive activity coiqmsiqg the steps of: 

providing a computer program; 

executing the computer program in a computer having a display screen, 
said computer program controlling di^lay of an icon on the ccMnputer display 
screen; 

providing means for wireless transmission of data from the computer; 

providing a handheld device having means for recdving said wireless 
transmission of data* means for executing a stored program and a display 
screen; 

transmitting first data IQrom the computer; 

removing the icon from the computer screen under control ctf the 
computer program in association with transmission of the first data; 

receiving the first data in the handheld device; 

displaying the icon on the handheld device display screen under control 
of the stored program in association with receipt of the fiist data. 
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